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Configure 
Address Network 
300 




YES 
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Determine 
mode 
304 




F/g. 5 



Initialize Address 
Network 
400 




YES 
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Suspend 
Clients 
404 



Complete 
outstanding 
transactions 
406 
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Packet 
Type 


Full Name 


Address Space 


Description 


Cacheable 


I/O 


RTS 


ReadToShare 


Y 




Requests read-only copy of cache line 


RTO 


ReadToOwn 


Y 




Requests writable copy of cache line 


RTWB 


ReadToWriteBack 


Y 




Requests to receive writable copy of cache line 
and send cache line to memory 


RS 


ReadStream 


Y 




Request read-once copy of cache line 


WS 


WriteStream 


Y 




Request to write entire cache line and send to 
memory 


WB 


WriteBack 


Y 




Request to send cache iine from owning device 
to memory, device does not keep copy 


WBS 


WriteB ackShared 


Y 




Request to send cache line from owning device 
to memory, device keeps read-only copy 


RIO 


ReadIO 




Y 


Request to read 10 locations 


WIO 


WritelO 




Y 


Request to write 10 locations 


INT 


Interrupt 






Sends an interrupt, target is specified by 
address 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RTS 


DATA 




RTO 


DATA 




RTWB 


DATA & PRN 


DATA 


RS 


DATA 




WS 


ACK&PRN 


DATA 


WB 


PRN 


DATA or NACK 


1 WBS 


PRN 


DATA or NACK 
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Transaction Type 


Initiator Receives 


Initiator Sends 


RIO 


DATA 




WIO 


PRN 


DATA 


INT 


PRN or NACK 


DATA or Nothing 
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Access Rights Symbol 


Access Rights Name 


Description 


Data Present? 


w 


Write 


Read and Write 


Yes 


A 


All-Write 


Write-oniy, must write entire cache line 


Yes (or ACK) 


R 


Read 


Read-only 


Yes 


T 


Transient-Read 


Read-only, read can be reordered 


Yes 


i 


Invalid 


No access rights 


Yes or No 



Fig. 10A 



Ownership Status Symbol 


Ownership Status Name 


Description 


Data Present? 


0 


Owner 


Owns cache line 


Yes or No 


N 


Not Owner 


Does not own cache line 


Yes or No 
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Access Right 


Ownership Status 
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Transaction Type 


New Owner 


RTS 


Previous Owner 


RTO 


Initiator 


RTWB 


Memory 


RS 


Previous Owner 


WS 


Memory 


WB 


Memory (or Previous Owner) 


WBS 


Memory (or Previous Owner) 
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Data and Address Queues 
720 



Promise 
Array 
904 



Transitory 

State 
Controller 
902 



Interface Controller 900 



Cache 
710 



State Info 
712 



Processing Unit 
702 
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StaceDescnptlon ~" - — — — 


jwum 


Waiting ror WAIT and ACK ror local WS. has write access and ownershio 


IWO 


Stable state with write access and ownership " " : " ~" 


(Hum .wailing for WAIT and A<-K Ear local WS. has read access and ownershio ~~ 




Waiting far DATA far local RTO, has read access and ownershio " ~ ~~ 


[ROae 


Waiting for INV and DATA far local RTC. has read access and ownership ' ~" 


iROd 
iROce 


[Waiting for INV for local RTO. has read access and ownership ~~" " 

■Waiting for WAIT ana DATA for local RTO. has read access and ownership 


iRO 


[Stable state with read access and ownership " ~~ ' 


!LOe 


Waning tor DATA ror local RTO. has no access rights, has ownershio ~ 


HQde 


Waiting for INV and OAiA for local RTO. has no access rights, has ownershio 


irOd 


Waiting ror INV ror local RTC. Has no access rights, has ownership — — 


jWNj 


Able co send DATA/ N ACK for local WB/WBS. has write access and no ownership 


lwini !AOle to send DATA for local RTWB. write access, no ownership ~ " ' — 1 


|WNh jWaiting for ACK for local WS, has write access, no ownership "~ 


iWINC 


;waitlng tor WAIT tor local RTO. has write access, no ownership ' — 


IWN 
! 


jStaoie state with write access, no ownership (caused by foreign transaction that took ownership, but for which no 
ropyback has yet been performed) H 


!ANi 


•Able co send DATA for local WS after performing write co entire cache line, no ownershio 


iRNj 


Able co send DATA/NACK for local WB/WBS. has read access and no ownershio 


iWNh Waiting ror ACK for Local WS. has read access, no owners tun "~ 


StiNg 


Waiting ror INV for locai WS. has read access, no ownershio ' ' — ~" ~~ 


iRNe 


Waiting for DATA for local RTO. has read access, no ownership — " 


IRNde 


Waiting for INV and DATA far local RTO. lias read access, no ownershio 


•kino iwaitiag Ear 1NV for local RTO. has read access, no ownership ' — 1 


P^ce iWaiting far WAIT and DATA for local RTO, has read access, no ownersnip 


! RNcd 'Waiting for WAIT and INV for local RTO. has read access, no ownershio 




; ;>ca0ie state with read access, no ownersnip " ~ 


• l in -Pcnarming reaoisj. wtucn may Oe reordered, for local RTS or RS. no ownershio 


|INk Waiting far local RTO. RTWB. WS. WB or WBS after receiving an ERR or EHRL. No acr^ nVntV no awn^hin 


aN] 


Able co send DATA/NACK lor local WB/WBS. has no access rights and no ownershio < 


ilNh 


Waiting lor ACK ror local WS or ror DATA for local RTWB. has no access rights, no awnershio 


llNg 


iWaiting xor INV far local WS or for INV for local RTWB, nas no access rights, no ownership " 


ilNe 


Waiting for DATA tor local RTO, has no access rights, no ownershio 


UNde 


Waiting for INV ana DATA for local RTO. has no access rights, no ownershio 


ilNd 


IWaiting tor INV cor local RTO. has no access rignn. no ownershio 


iiNce 


Waiting for WAIT ana DATA far local RTO. has no access riHtits. no ownersnin " 


UNcd Waiting for WAl l ana IN V ror local RTO. has no access rigtits. no ownershio ~ 


UN a 

ilN 


Waiting ror QAIA ror tocai tcia. uaia may grant read access, has no access rights, no ownersnip 



Action 
Cede 


leaning j Comment. 


1 


/= 


-cmmii to seno an ACK packet as a 
copyback by appending an entry for the ' 
received foreign packet in a ccpyback list. 
Set coov tac to L 


AuK packet may be sent from anv state that allows 
copyback packets tc be sent. It must be sent within a 
finite time of first entering sucn a state, regardless of 
what other oackets have been received. 


d 


Commit to send DATA and/or ACK cackets 
rcr all outstanding copyoacks far this cache 
iine. Next, set copy tag to W. Then, perform 
state transition based on current state & 
local packet being received. 


It sending copybacks changes the state from a state 
X tc a state Y ; the local packet being received wiii be 
received in state Y (and as a result, the entry for 
state Y in the table must be consuited to oetermine j 
ihe state transition cau^eH hv r-^&winn tig inp-si \ 
cacket). j 


/G i 

: 

; 

; 

j 
i 


commit to senc DA i A packet for icca! 
RTWE, WS 3 WE, or WBS transaction. DATA 
packet is sent in resoonse to receivino a 
PRN packet for this 'transaction . 


DA i A packet may not be sent until a PRN packet is 
received. It must be sent within finite time of 

iw^wivinu ult Hi \Im paCi\BI 6: neVing rntcfec c State 

that permits the packet to be sent, regardless of what 
other packets have been received. 


si 


uiear outstanainc copyback commitments 
for this line by removing them from the 
copyback list Do not send DATA or ACK 
packets for entries that were on the 
copyback list. Next perform state transition 
based on current state & local packet being 
received. 


ihis action code is usee in resoonse to receiving an 
=RR or ERRL packet. If an ERR packet was 
received in place" of a PR or PRACK packet, or if an 
=RRL packet was received in piace of a DATAF 
packet, a DA i A oacket mav be sent to the error 
device. 


/i 


Commit to send a DATA packet as a 
copyback by aDpending an entry for the 
received foreign packet in the copyback list 
Set CO DV ted to 1. 


DA i A packet may be sent from any state that allows 
copyback packets tc be sent. It must be sent within 
finite time of first entering such a state, regardless of 
what other oackets have been received. 


i .'! ! Set wnKtso to 1. 


I m 


j commit to send MACK packet for iocai WE 
j or WES transaction & set write tea to W. 
NACK packet is sent in response ta 
receiving a PRN cacket for this transaction 


j NACK packet may be sent at any time after receiving 
| the PRN packet. It must be sent within finite time of " 
I receiving the PRN packet, regardless of what other 
1 oackets nave been received. 


It 

i 
i 


Commit to send a DATA packet as a 
; copyback by apoending an entry for the 
received foreign packet in the copyback iist. 
if coov tac is W, set coov tac to R. 


DA i A packet may be sent from any state that allows 
copyback packets to be sent. It must be sent within 
unite time of first entering sucn a state, reaardless of 
what other oackets nave been received. ~ 


! 


is. 


set write tac tc k. 






/w 


Commit to seno a DA i A packet as a 
\ copyback by apoending an entry for the 
j received foreign packet in the copyback list. 


DA i A pscket may be sent from any state thai allows 
cooyback packets to be sent If must be sent within 
! finite time of first entering such a state, regardless of 
\ wnat other oackets nave been received. ~ 




<y | m espy sg is set copy tag u j Used tc record investing transactions while a 
: — iCODvbacK Tor a rcreicn mercery remac is Denriinn. 


1 


/i . a write sg is R 5 set write tag to i. 


Jseo tc recoro invaiioatino transactions wniie a iocai ; 
WES transaction is oenoinc. 
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140 A 



Address Network 
150 A 



Processing 
Subsystem 
142AA 



Processing 
Subsystem 
142BA 



Memory 
Subsystem 
144AA 



Memory 
Subsystem 
144BA 




Imerracs 
148A 



1 

I T 



Data Network 
152A 



Address Network 
150B 



140B 



Processing 
Subsystem 
142AB 

~~t~t 
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Subsystem 
142BB 



Memory 
Subsystem 
144AB 



Memory 
Subsystem 
144BB 
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Subsystem 
146B 



interface 
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Address Network 
150C 



HOC 
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Subsystem 
142AC 
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Subsystem 
142BC 



Memory 
Subsystem 
144AC 



Memory 
Subsystem 
1MBC 
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Subsystem 
145C 



! T 



Interface 
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gTag 


Description 


gM 


The maximum access right within the node is Write Access 


gs 


The maximum access right within the node is Read Access. No 
client device in the node can have Write Access. 


gi 


The maximum access right within the node is Invalid Access. No 
client device in the node can have Read or Write Access. 



Fig. 21 



Packet 
Type 




Address Space 


Description ! 


Full Name 


Cacheabie 


I/O 


□ CTQ 


Proxy RTS 


Y 




Request from an interface in a gS org! node in 
response to an RTS request from another node 


i i \ I CjlVi 


Proxy RTS Modified 


Y 




Request from an interface in a giM node in 
response to an RTS request from another node 


PRTOM 


Proxy RTO Modified 


Y 




Request from an interface in a gM node in 
response to an RTO request from another node 


PRTG 


Proxy ReadToOwn 


V 
1 




Request from an interface in response to an RTO 
reqest from another node 


PU 


Proxy Upgrade 


Y 




Request from an interface asking memop/ to 
supply data for an outstanding RTO 


PDU 


ProxyDataUpgrade 


Y 




Request from an interface asking memory to 
update gTag to gM; interface supplies data for an 
outstanding RTO 


PRSM 


Proxy ReadStream 
Modified 


Y 




Request from an interface in a gM node in 
response to RS request from another node 


i HVI 


Proxy invalid ate 
Modified 


Y 




Request from an interface in a gM node to 
invalidate data in caches and memory 


P! 


Proxy Invalidate 


Y 




Request from an interface in a gS or gl node to 
invalidate data in caches and memory 


PMR 


ProxyMemoryRead 


V 

1 




Request from an interface to memory to read 
coherency state(s) and data or meta-data 


PMW 


ProxyMemoryWrite 


Y 




Request from an interface to memory to write 
coherency state(s) and data or meta-data 
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Packet 
Type 


Full Name 


Description 


QATAM 


Daia-Meta 


Data packet containing data and coherence state information 


DATAN 


Data-NoPull 


Data packet sent in response to FRT3M indicating no PRN will be 
coming 


RE? 


Report 


Report from memor/ to an interface indicating a transaction to be 
handled by the interface 
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Subtransactian 


Preexisting 

Global Access State 


New Global Access State 


PRTSM 


Modified 


Shared 


FRTOM 


Modified 


Invalid 


PRTO 


Shared, Invaiid 


Invalid 


PU 


Shared 


Modified 


PDU 


Shared, invalid, Modified 


Modified 


PRSM 


Modified 


Unchanged 


P1M 


Modified 


Invalid 


PI 


Shared, Invalid 


Invalid 


PMR 


Shared, Invaiid, Modified 


Unchanged 


PMW 


Shared, Invalid, Modified 


Equal to new global access state 
specified in DATAM packet 
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Home Node 140H 
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Home Node 140H 
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Home Node 140H 

RTO 




Acknowledgment 




Slave Node 140S 
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Data In 



820A 



Address In 



820B 



Bus Agent 
810 



Queue 
814 



Address Out 
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Request Agent(s) 
802 



Home Agent(s) 
804 



Global Information 
850 



Slave Agent(s) 
806 
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Communications In/Out 
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PRTSM Home Node 140H 
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Data\ 
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Requesting Node 14QR 
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Response Info 


gTag 


Home Memory Subsystem Action 


No 


gM 


BC Mode- Allow owning device to respond. 
F i P Mode-- Forward response to owning 
device 


No 


gs 


Send REP packet to interface if write access 
requested 


No 


gi 


Send REP packet to interface 


Yes 


gM 


Respond with copy of the requested coherency 
unit 



Fig. 35 



Response 
Info 


Memory Subsystem's Action 


mN 


Does not respond with copy of 
coherency unit because a cache within 
the node owns the coherency unit 


mR 


Does respond because memory is the 
owner 


mS 


Does respond to requests for shared 
access because memory has shared 
copy and no active device has 
ownership; does not respond to 
requests for write access 


ml 


Does not respond because memory's 
copy is invaiid 
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Fig. 37 



I 

J 

Send PRTOM, PRTSM, 
PIM, or PRSM specifying 
the coherency unit 
500 



Respond = false 
502 



i 

T 



Current record = oldest 
record in OTQ specifying 
the coherency unit 
504 




Respond = 



False: Receive data packet 
from active device in 
response to packet sent at 
500. Send received data in 
coherency message 

True: Send data from buffer 
in coherency message 

512 



Current record = 



RTO: Send data packet using data from 
buffer if respond = true & set respond = 
false 

RS, RTS: Send data packet using data 
from buffer if respond = true 

WB, WBS: Send PRN packet Set 
respond = true if responsive DATA 
packet received & store received data in 
buffer 

WS, RTWB: If respond = false, send 
PRN & set respond = true & store 
received data in buffer. If respond = true, 
send PRACK or DATAP 

508 



F/g. 37 A 



Current record = next oldest record in 
OTQ specifying the coherency unit 
510 
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Packet 
Type 


Full Name 


Description 


RWB 


Remote WB 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WB transaction 


RWBS 


Remote WBS 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WBS transaction 


RWS 


Remote WS 


Request sent from an active device in a multi- 
node system to an interface in order to initiate a 
WS transaction 



Fig. 39 






f Interface >p 




148H J 


pmw/ 






PRN/ / 




/ DATAM 








Home Node 140H 



Fig. 40 




Fig. 41 



